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Abstract 

Reaction networks are commonly used to model the evolution of populations of species subject to 
transformations following an imposed stoichiometry. 

This paper focuses on the efficient characterisation of dynamical properties of Discrete Reaction 
Networlis (DRNs). DRNs can be seen as modelling the underlying discrete nondeterministic transitions 
of stochastic models of reactions networks. In that sense, any proof of non-reachability in DRNs directly 
applies to any concrete stochastic models, independently of kinetics laws and constants. Moreover, if 
stochastic kinetic rates never vanish, reachability properties are equivalent in the two settings. 

The analysis of two global dynamical properties of DRNs is addressed: irreducibility, i.e., the ability 
to reach any discrete state from any other state; and recurrence, i.e., the ability to return to any initial 
state. Our results consider both the verification of such properties when species are present in a large 
copy number, and in the general case. The obtained necessary and sufficient conditions involve algebraic 
conditions on the network reactions which in most cases can be verified using linear programming. 

Finally, the relationship of DRN irreducibility and recurrence with dynamical properties of stochastic 
and continuous models of reaction networks is discussed. 

1 Introduction 

Reaction networks describe the possible transformations between species in a system, subject to stoi- 
chiometry constraints (e.g. 2A + B ^ C + D). They are widely used for fine-grained modelling of various 
complex dynamical system, and in particular biochemical systems. Typically, reaction network models are 
equipped with kinetic laws in order to take into account the influence of the various speeds and propensities 
of the involved reactions on the overall dynamics. Depending on the nature of the systems and interacting 
species, those kinetics may follow different laws. These reacti on networks and kinetic rules are then g enerally 



interpreted either in continuous frameworks, such as ODEs (jFeinbera 



1979 



Craciun et al 



20061 1. which 



relates the dynamics of the concentra t ion of the species; or in stochastic frameworks, such as continuous 



time Markov chains (Wilkinson 



2006 



Anderson et al 



20101 ). which precisely track the population (copy 



number) of each species along the time. 
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In practice, such modelling techniques face two challenges: the actual kinetics are most often unknown 
and may substantially vary between systems sharing the same reaction network; and formal analysis of 
the emerging dynamical properties is computationally intractable for large-scale continuous and stochastic 
models. 

In this paper, we propose a more abstract level of interpretation of reaction networks, by focusing on the 
nondeterministic discrete evolution of the population of the species. Given the population of each species 
(discrete state), the system can evolve along the application of any reaction where the minimum amount of 
copy number of transformed species is present. We consider that only one discrete reaction can be applied 
at a time. Such nondeterministic systems can be formally considere d as the discrete underlying dynamics 



of stochastic models of reaction networks (jFaaes and Soliman 



2008|) 



In such a setting, dynamics of Discrete Reaction Networl<s (DRNs) naturally delimit the dynamics of 
concrete stochastic systems, whatever the kinetic laws and constants: if a reachability is proved impossible 
in a DRN, it is also impossible for any particular stochastic model of the network. In the case where the 
rate (or probability) of a reaction in the stochastic model never becomes zero, the (discrete) reachability 
properties of the stochastic model are equivalent with the corresponding properties of the underlying DRN. 
In general, one can think of a DRN as underlying any discrete stochastic model of the reaction network. 

Here, we demonstrate that some general dynamical reachability properties can be efficiently derived from 
a DRN: the capacity to reach any discrete state from any other state (irreducibility); and the reversibility of 
the reachability properties (recurrence). Such properties are both considered in the case where species are 
present in a large copy number as well as in the general case. These results help provide an understanding 
of the possible global dynamics of reaction networks, and give a direct relationship between the structure 
of the set of reactions and the verification of the mentioned dynamical properties, without any assumption 
on kinetic laws. 

The main objects and results presented in this paper are summarised below. 



Notations. For any a, b in Z, [a; b] denotes the set of integers between a and b that is {a, a + 1, ... , b}. 
For any x,x' in Z'', x is greater than x', denoted x >z x', if and only if every component of x is greater 
than the corresponding component in x', i.e., for any / in [1; d], x,- > x'. The set of matrices of elements 
in G having n lines and d columns is denoted by G"^^. If V is in G"^'^, for any j G Vj is the 

line, and V, is in . Given a field F, and a matrix V G g"^'^ , the span of V over F is denoted by 
spanpV = {AV | A e F"}. Finally, the null vector is referred to as 0. 

Discrete Reaction Networks We consider a set of reactions between d species Aj, / G [1; d] of the form 
CiAi + --- + CdAct — > c[Ai + ■ ■ ■ + c'^Ad (1) 
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Example (a) Example (b) 

Figure 1: Two DRNs with 3 reactions between 2 species A and B. 

where for any / in [l;c/], c, and c- are in Z>o. The reaction can be applied as soon as the population 
of species A, is at least c,-, for any / in [l;c/]. Its application decreases the population of species A^ 
by c, and then increases it by c'. Such a reaction can be summarised by two vectors of dimension d: 
1/ = (c( — Ci, ■ ■ ■ , — q), the drift vector describing the population changes after application of the 
reaction; and o = (ci,-- - , Cc/), the origin of the reaction, that is the minimum required population of 
species for applying the reaction. 

In such a setting, a Discrete Reaction Network (DRN) of n reactions between d species can be defined 
by a couple (V, O) of two matrices having d columns and n rows: V gathers the drift vectors of the n 
reactions and O their origins (Def. 11.1)) . We impose that each reaction can be applied at least once from 
its origin, i.e. the population of species does not reach negative values. 

Definition 1.1 (Discrete Reaction Network). A Discrete Reaction Network (DRN) Is a couple (V, O), where 
V e Z"^'^, O e Z!;^^, and V/ e [1; n], O, + V, tO.n is the size and d is the dimension of the DRN. 



Example. Flg.[^shows two examples of DRNs with 3 reactions between 2 species. 
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We will see in Sect. [3]and|3]that these similar-looking DRNs have difference dynamical properties. 

Discrete transitions The population of the d species of the DRN forms a discrete state (or point) of the 
DRN, and is represented as a vector x in Z>g. At x, only the reactions j in [1; n] such that x ^ Oj can 
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occur. The occurrence of one of these reactions leads to the state x' = x + Vj, with necessarily x' in Z>o. 
The transition relation (Def. II. 2p is defined such that x — > x' if and only if x' can be reached by the 
occurrence of one (and only one) reaction from x. The binary relation — >* extends the binary relation — ?• 
by considering the successive occurrence of any number of reactions. Hence for any x, x' in Z>q, x — ?•* x' if 
and only if there exists a sequence of reaction occurrences from x leading to exactly x' which never makes 
negative the population of any species. 

Definition 1.2 (Transition relation -^). Given a DRN (V, O) and two points x,x' G Z>g, x ^(v.o) x' if 
and only if3i G [1; n] sucti ttiat x ^ O; and x + V, = x'. — t-^^ /s tlie transitive closure of binary relation 
— >(y o). When clear from context, — >(v,o) written as 

Irreducibility and Recurrence In this paper, we focus on two dynamical properties of DRNs: 

• Irreducibility: a DRN is irreducible if and only if one can reach any point x' G Z>o from any point 
X G Z>o (Def.fOl). 

• Recurrence: a DRN is recurrent if and only if one can always reverse the application of any sequence 
of reactions (Def. fO]) . 

It is worth noticing that any irreducible DRN is recurrent (Remark[T|). 

Definition 1.3 (Irreducibility). DRN {V,0) /s irreducible /f and on/y /fVx, x' G Z^o, x ->* x' and x' ^* x. 

Definition 1.4 (Recurrence). DRN (V, O) is recurrent if and only ifMx, x' G Z>o, x ->* x' ^> x' ->* x. 

Remarl^ 1. Irreducibility Recurrence. 

In addition of considering irreducibility and recurrence from any possible population of species of the DRN, 
we also investigate a weaker version of those dynamical properties when assuming the species are present at a 
Large Copy Number (LCN). This basically restricts the above dynamical properties to population of species 
greater than a certain threshold Mq in Z>g. We refer to these weaker properties as LCN irreducibility 
(Def. II. sp and LCN recurrence (Def. II. 6p . respectively. Note that the inclusion relationship between 
irreducibility and recurrence still holds (Remark[2|). 

Definition 1.5 (LCN Irreducibility). DRN (V, O) is LCN irreducible if and only ifBMo G Z|o such that 
Vx, x' G Z|o with xh Mo and x' h Mq, x ^* x' and x' x. 

Definition 1.6 (LCN Recurrence). DRN (V, O) is LCN recurrent If and only if 3Mo G Z^g such that 
Vx, x' G Z^o with xh Mq and x' ^ Mo, x ^* x' => x' ->■* x. 

Remaric 2. LCN Irreducibility LCN Recurrence. 
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Main Results 

In Sect. [31 we first demonstrate that LCN irreducibility is equivalent to have both the strictly positive real 
span of drift vectors being R'^ and the integer span of drift vectors being 11^ . 

Theorem (fT^ . DRN (V, O) is LCN irreducible if and only /f spang^^V = and span^^V = Z'' . 

Verifying spanjj^jjV = M'' can be done using linear programming, and verifying span^V = Z'' can be also 
efficiently done by computing, for instance, the Hermite normal form of V. 

Then, we show additional properties that lead to full irreducibility: self-starting (capability to reach a 
strictly positive point from 0) and self-stopping (capability to reach from a strictly positive point). 

Theorem (|3.8p . DRN (V, O) is irreducible if and only if {V, O) is LCN irreducible, self-starting and self- 
stopping. 

Self-starting and self-stopping properties can be decided using a backtracking algorithm combined with linear 
programming to find a particular order of reactions 

In Sect. O we prove that LCN recurrence is equivalent to the presence of in the strictly positive real 
span of drift vectors. Surprisingly, no integer constraints need to be checked, so this property can be easily 
decided using linear programming. 

Theorem ((4r2|) . DRN (V, O) Is LCN recurrent if and only ifO e span^^^V. 

Sect. [5] applies those results to DRNs modelling biological systems. Presented results and their relation- 
ships with stochastic and continuous models of reaction networks are discussed in Sect.[6l For example, we 
show how we can use the theorems above to check that common phosphorylation chain networks are LCN 
recurrent and some circadian clock networks are LCN irreducible. 

2 Additional definitions, basic properties 
2.1 Set of points and paths manipulation 

We introduce the following notations to manipulate set of points and paths (sequences of reactions): 

lowerpoint Given a set of m points {xi, . . . , x^} C Z'', we denote by lowerpoint({xi, . . . , x^}) a point that 
is lower than all the given points: 

lowerpoint({xi, . . . ,Xm}) = y G Z'' : V; G [1; d],y, = min{xj,, \j G [1; m]} 
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orderings Given A G Z"q with I = X^/Li we denote by orderings(A) all the mappings vr : [1; i-> [1; n] 
which map exactly A, distinct values to /, V/ G [1; 

orderings(A) = {tt : [1;£] ^ [1; n] \ V; G [1; n], A, = #{j G [1;£] | ttO) = /}} 

where #{ei, . . . , e^} = k. 

Hereafter, we use such mappings tt : i-> [1; n] to refer to paths, i.e. sequences of reactions. In 
such a context, A G Z"o should be understood as the vector giving the number of times each reactions 
in [1; n] has to be used in a path; and orderings(A) as all the possible permutations of such paths. 

path application (x • tt) Given a DRN (V, O) of size n and dimension d, a path tt : [1; i-)- [1; n], and an 
initial point x G Z'', x • tt is the set of points resulting from the sequential application of tt from x: 

k 

x.7r = {x + ^ I /CG [0;£]} . 
/=i 

2.2 Inverse DRN 

The inverse DRN (Def. 12. 1] ) is defined by the negative drift vectors and the origins shifted by the original 
drift vector. For instance, the inverse of the reaction described in Eq. ([T]) results in: 

(ci + c[)Ai + • • • + (Cd + c^)/\d CiAi + ■■■ + CdAd (2) 

Definition 2.1 (Inverse DRN). Given a DRN (V, O), (V, O)"^ = (-V, O + V) is tiie inverse DRN. 

Lemma 2.2. x — >(v,o) ^' '^=^ ^(v,o)-i ^■ 

2.3 Basic properties 

From the definition of transitions between the discrete states of the DRN fDef. ll.2( ). one can easily derives 
that if X x' then any succession of reactions from x to x' can be applied from x (positively) shifted by 
any 5 G Z>q, leading to x' + 5 (Lemma [2.3p . In the particular case when — ?•* x', one can instantiate the 
latter property with 5 = x', which by transitivity of — > leads to — >* ax' with a G Z>o (Lemma [2.4p . 

Lemma 2.3. Given x, x' G Z>o, x ->* x' => V(5 G Z>o, x + 5 ->* x' + 5. 

Lemma 2.4. ^* x' ^ Va G Z>o, ax'. 

Given X, x' G Z>q and A G Z" q such that x' = x + AV, it is sufficient (but not necessary) to show that 
there exists tt g orderings(A) verifying Vj G [1; n], lowerpoint(x • tt) h Oj to conclude that x — x'. We 
remark finally that lowerpoint(x • tt) = x + lowerpoint(0 • tt). 
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3 Deciding Irreducibility 

DRN (V, O) is irreducible if any point in Z>o can be reached from any other point in Z>o (Def. II. 3p . We 
first address the LCN irreducibility, and then exhibit supplementary properties that lead to full irreducibility. 

3.1 LCN Irreducibility 

Recall that DRN (V, O) is LCN irreducible if and only if any point above a certain Mq G Z>g can be reached 
from any other point above Mq (Def. II. 5|) . 

Before using the LCN hypothesis, we remark that the DRN is irreducible if (and only if) one can reach 
each elementary point e,, V/ G [1; (e, is the d-dimensional vector having at each of its component, 
except the /"^ component being 1) from and vice-versa (Lemma [3.ip . 

Lemma 3.1. DRN (V, O) is irreducible if and only ifii e[l;d],Q^* e, and e, ->* 0. 

Note that a necessary condition for LCN irreducibility is that span^^gV = Z''. This property is actually 
sufficient for LCN irreducibility fLemma l3.2p by choosing Mq big enough such that for any / G [1; c/] at 
least one reachability path from Mq to Mq ± e, never goes below 0, and such that Mq is greater than all 
the reaction origins. 

Remarking that spanQ^j,V = <^y' <^ spang^jjV = W CLemma lTS)) . Theorem 13. 4! establishes that verifying 
span^^gV = Z'' is equivalent to verifying both span^V = Z'' and spanR^^jV = W . 

While the verification of span^^^V = Z'' involves integer programming techniques, verifying if spanR^^jV = 
W' and span^V = Z'' can be done more efficiently: the former can be decided using linear programming, 
for instance by first checking if G spang^^V and the n if spanB^„V = R'^; the latter can be decided, for 



instance, by computing the Hermite normal form of V ([Cohen 
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Lemma 3.2. DRN (V, O) is LCN irreducible span^^^V = Z''. 

Proof. span^^^V = Z^ ^ V/ G [1; d], 3X'-+, X' - G Z^q : A'-+V = e, A A''-V = -e,. 

For each / G [1; d] and s G {+, — }, we pick an arbitrary ordering tt g orderings(A''^). 

If Mq is defined such that V/ G [1; d], Vs G {+, G [1; n], Mq + lowerpoint(0 • tt''^) >z Oj, then it 
is clear that V/ G [1; d], Mq Mq + e, and Mq + e, Mq. □ 

Lemma 3.3. spang^^^V = M'' spanQ^„V = Q'' . 

Proof Let us consider A G ]R"q such that AV = w, where w G Q'^ . 

Considering a basis {Pa)a£i of K over Q such that Pao = 1 (i-S- Vr G K, 3 a unique choice of r" G 
Q-r = Eaeir^Pc). Then AV = E'U^J^J = E'U^^aei ^?Pc.)Vj = Ece/CE^li \"V,)/3„ = w with 
A" G Q. On the other hand, w = w^ac, +'}laei\{a,}^PoL- Hence, EjLi \"°V, = w and Va G /, a 7^ 

ao,E;=iA;v, = o. 
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Therefore, w = ^T^J+EaeiMa.yiEU ^fVj)P. = EaeiiEU = E;=i(Ece/ 

with /3ao = 1 and Va G /, q; 7^ Q!o,/3a G (Q. □ 

Theorem 3.4. span^^^j V = •<=^ spariR^^ V = W and span^V = Z'^ 

Proof. (^) spariR^^V = M"' <^ spariQ^^V = Q'' (Lemma [33D. Therefore, 3A G Q!!.o such that AV = and 
3a G Z>o such that aA G Z^q. Moreover, V/ G [1; d] and Vs G {+, -}, 3A''^ G Z" such that A'^^V = se,. 
Hence, there exists /3 G Z>o such that A* = /3aA + A''^ with A* G Z>o, resulting in A*V = se,. (^) 
straightforward by remarking that span^^jV = Z'' =^ spang^^V = Z^. □ 

Example. One can check that both examples of Fig. [I] verify span^^jj V = W . However, the computation 
of IHermite normal forms shows that only example (b) verifies the second necessary condition span^V = Z"^. 
Hence, example (a) is not LCN irreducible whereas example (b) is LCN irreducible. 

3.2 Full Irreducibility 

In this subsection, we demonstrate that the DRN is totally irreducible if and only if the DRN is LCN 
irreducible and is both self-starting (Def. 13. Sp and self-stopping (Def. 13. 6p . A DRN is self-starting if at 
least one strictly positive point can be reached from 0, and is self-stopping if there exists at least on strictly 
positive point from which can be reached - which is equivalent to the inverse DRN being self-starting. 

Definition 3.5 (Self-starting DRN). DRN (V, O) is self-starting if and only if3x G such that x. 

Definition 3.6 (Self-stopping DRN). DRN (V.O) is self-stopping if and only if inverse DRN (V, O)"^ is 
self-starting. 

Lemma [TTl establishes that a DRN is self-starting if and only if there exists a sequence of d reactions 
(not necessarily unique) such that for each dimension at least one reaction of this sequence has a positive 
drift along that dimension, and such that the origin of the k^^ reaction belongs to the positive real span 
of the k — 1 preceding drift vectors (the first reaction having necessarily as origin). Therefore, one can 
derive a backtrack algorithm to determine if such an ordering of reactions exists. 

Then, Theorem 13. 81 states that if a LCN irreducible DRN is both self-starting and self-stopping then it is 
irreducible. Indeed, if the DRN is self-starting, then there exists a strictly positive point x G Z>o such that 
X. From Lemma [Z3] this implies that — ?•* x -|- Mq. Finally if the DRN is also self-stopping, one can 
easily show that there exists a point x' ^ Mq such that x' — ?•* 0. Because the DRN is LCN recurrent, we 
know that any pair of points above Mq is reversibly reachable. Hence, by using Lemma [Z3l one can verify 
the existence of a reversible path from to all e,, / G [1; d]. 

Informally, the self-starting property allows to reach the LCN region, and the self-stopping allows to 
reach any ±e, or from any point in the LCN region. The LCN irreducibility property finally ensures that 
those two paths can be connected. This is illustrated in Fig.[2l 
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Figure 2: Illustration of the reasonning for Theorem 13.81 on irreducibility. If the DRN is self-starting, by 
repeating the reactions, we eventually reach the LCN region from 0. In the same manner, if the DRN is 
self-stopping, we eventually reach from a point in the LCN region. If the DRN is LCN irreducible, any 
point in the LCN region can be reached by any other point in the LCN region. In such a setting, one can 
construct a path from to each elementary vector, and vice-versa. 

Lemma 3.7. (3x e Z% s.t. x) 3(j : [1; d] H> [1; n] with: 
1. V/c e [1; d],3i e [1; d],Va{i),k > 1, and 



2. 0<,(i) = and V/c G [2; d], O^ik) e spanR^^ 



Proof. (^) Let us define V/( G [1; d],Q'' = {j e [1; d] \ 3i e [1; k],Va{i) > 1} and x'^ such that V/ G [1; d], 
xj" = lA i e Q** and xj" = A i Q'' . We show by induction that V/c G [1; d],3x' h s.t. ->* x': 

• k = l: ^ V^(i) with Vj G Q\ V<^(i)j > 1. 

• k + 1: by induction, (2), and Lemma [2741 G Z>o such that ax'^ > Oc(k+i) (with ->* ax''). 
Hence, ax'' -> ax'' + Vct(/(+i). We remark that if 3/ G Q''+^ such that (ax'' + Vcr(;<+i))/ < 1, then 
necessarily / G Q''. Hence, 3P G Z>o such that {Pax'' + Vc^k+i)) h x''+^. Therefore, x' with 
x'hx^+y 

Finally, as Q'^ = [1; d], 3x G Z^q s.t. x. 

(^) ^* X ^ 3£ G Z>o,37r : [1;£] ^ [1; n] with Eti V^(,) G Z^q. and V/ G [1; £], Ej=i Ko) ^ 
Let us define ? : [1; d] i-> [1;^] iteratively, starting with <;(1) = 1 and V/c G [2; d]: 

. with = 0' G [1; d] I $i G [1; /c - 1], V,(,(,)),, > 1}, 
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Ifu" = 0, <;{k) = 1; 

otherwise, ?(/c) = min{mG [?(/c— 1) + 1;£] | 3J e w'^ , V7r(m)j > !}■ We remark that this minimum ne- 



cessarily exists (otherwise x ^ ^yo), and Vm G [?(/<— 1); ?(/c) — l], X)j=i """0) ^ spanj 



V v.(.-i) ; 



From construction, ct = ? o tt verifies (1) and (2). 



□ 



Theorem 3.8. DRNiV.O) is irreducible if and only if {V ,0) is LCN irreducible and 3x e Z% s.t. ->(vo) 
X and 3x' G Z^q s.t. — x' ('/.e. (V, O) is self-starting and self-stopping). 

Proof (=^) obvious. 

(<;=) If (V, O) is LCN irreducible, there exists a minimum origin Mo G Z>q such that Vx y Mq, x' h A//o, 
X 0^ x' and x' — x. In addition, (V, O)^^ is LCN irreducible, with a minimum origin Mq g Z>q. 

From Lemma[Z31 3q; G Z>o such that ax h Mq, ax h M'q, ax' >z Mq, and ax' >z M'q, with -^*^y ax 
and ^(vo)-i ct^' ■ Hence, V/ G [1; d], from Lemma [Z3l 

• ^(v,o) ^(v.o) (q;x + e,) ^ (ax' + e,) o) (0 + e,), and 

• (0 + e,) ^*y^^) (ax + e,) -^[^ o) ^(v,o) ^(v,o) 0- 

□ 

Example. One can easily show that the two examples in Fig. [I] are self-starting and self-stopping. Using 
LCN irreducibility criteria from the previous subsection, we conclude that example (b) is irreducible (recall 
that example (a) is not LCN irreducible, so it is not irreducible). 



4 Deciding Recurrence 

Recall that DRN (V, O) is recurrent if and only if for all pair of points x, x' G Z>o, x — >* x' implies x' x 
(Def. II. 4|) . First, we show that the LCN recurrence is equivalent to the presence of the null vector in the 
strictly positive real span of drift vectors. Then, we discuss sufficient conditions to obtain the recurrence, 
and reduce the full recurrence property to a set of reachability properties. 

4.1 LCN Recurrence 

Let us ignore reaction origins and population positivity constraints. If G spanz^gV, it is clear that from 
any point x, one can undo any reaction application and then go back to x: G spanz^^^V =^ 3A G Z"o such 
that AV = 0. Hence V/ G [1; d], let us define A' G Z^^ with A; = A, - 1 and A; = A/^, V/c G [1; d], k ^ i: 
we obtain A'V = —V,. 
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Figure 3: Black dots are the points of the lattice generated by V. The lattice fundamental regions (formed 
by the basis) are delimited by gray lines. 

By following the proof of Lemma [3?3l we remark in Lemma l4~T] that G spanQ^^V (hence G span^^^V) 
is equivalent to G spanjj^jjV. This can be verified with linear programming. 

Lemma 4.1. G spanQ^^^V <s=^ G spanR^^jV. 

Proof. (=^) obvious. (■^) same proof as for Lemma [T3l with iv = 0. □ 

Finally, Theorem 14. 2l establishes that LCN recurrence is equivalent to G span]R>oV. The main difficulty 
is to prove that there exists a Mo G Z>o such that it is possible to reverse all the reactions connecting any 
pair of points above Mq by staying in Z>o. For that, we consider the basis B = . . . , b^} of the free 
Z-module generated by V. It is worth noticing that, because G spanxj^gV, V/ G [1; k], fa, G span25.(,V. Let 
us pick Mo large enough such that there exists a sequence of reactions from Mo that can be successively 
applied (i.e., never below their origins) and that goes to all the vertices of the fundamental region formed by 
B that are adjacent to Mo. Then any pair of points above Mo that is connected can be reversibly reached 
from each other. Fig. [3] illustrates this reasoning. 

The proof of Theorem 14.21 also indicates that the reachability graph above Mo is maximal: if x + 5 
x' + 5 when x h Mq, x' h Mo,5 e Z^q, then x x'. This is stated by CorollarvR31 

Theorem 4.2. (V, O) is LCN recurrent ■<=^ G spanR^^jV. 

Proof. (=^) straightforward. 

(■^) Let us consider B = {bi, . . . , b^} the basis of the free Z-module generated by V. 

From Lemma \A~T\ G span^^^V, which implies V/ G [l;/c],±fa, G spanz^gV. Hence, V/ G [l;/(],Vs G 
{+, — }, 3\''^ G Z"q such that A''^V = fa''^ = sfa,. Let us pick an arbitrary ordering tt''^ g orderings(A''^). 

Let us define Mq g Z^q such that VH : [1 : 2k] ^ (/, s) with / G [l:k],s G {+,-}, and V/,/' G 
[l;2k], □(/) = □(/') ^1 = 1', then V/ G [l;2/(],Vj G [1; n]. Mo + lowerpoint((2|,7ii i)n(m-i)),^n(m)-) y 
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From Mo construction, the set of lattice fundamental regions formed by . . . , intersecting Z>Mo 
is connected and fits in Z>o- Moreover, each edge of those fundamental regions can be translated to a 
sequence of drift vectors v eV in Z>o. Therefore, Vx, x' > Mq x — >' x' x' — > x. □ 

Corollary 4.3 (Reachability Graph Saturation), /f G span^^^V then there exists Mq g Z>q such that the 
reachability graph on the set IVIq+Z^q becomes constant in the sense that: ifx — >* x', and x — 6, x' — 6 h 
for some 5 e Z>o, then x - 5 ^* x' - 6. 

Example. From previous section, we hinow that example (b) of Fig. [I] Is irreducible hence recurrent. In 
addition, one can verify that example (a) is LCN recurrent. 

4.2 Full Recurrence 

Assuming DRN (V, O) is LCN recurrent, if 3x* G Z>o such that ^* x* ^* 0, then (V, O) is recurrent 
fLemma l4.4p . Indeed, using Lemma [2741 3a G Z>o such that ax* ^ Mq. Then, for any pair of points 
X, x' G Z>o, if X ->* x', then, by Lemma 12.31 x + ax* x' + ax* . Because the DRN is LCN recurrent, 
x' + ax* X + ax*. Hence, x' x. We remark however that, to our knowledge, there is no efficient 
general method to verify if — ?•* x* — >* 0. 

Lemma 4.4. If DRH (V, O) is LCN recurrent and 3x* G Z^g such that ^* x* and x* ->* 0, then (V, O) 
is recurrent. 

Proof Let us define a G Z>o such that ax* >z Mq. We have the following implication: Vx,x' G Z>q,x 
x' =^ x' ^* x' + ax* ^* X + ax* ^* x . □ 

In the general case, and independently of LCN recurrence, we notice that recurrence is equivalent to the 
reachability of the origin of each reaction from the point that is its origin plus drift vector (Lemma [43]). 
Again, there is currently no efficient general method to verify these reachability properties. 

Lemma 4.5. DRN (V, O) is recurrent if and only ifVJ G [1; n], Oj + V, ^* Oj. 

Proof (^) straightforward. (<^) Vx G Z|o, Vj G [1; n] : x ^ Oj.x -> x + Vj ^■* x □ 
The above lemma allows to conclude that any weakly reversible reaction network i s recurrent (Lemma[4 



Johnston et al 



(12012) 



A reaction network is weakly reversible if each reaction is part of a cycle of reactions 
for instance X — ?• V; V — ?• Z; Z ^ X is a weakly reversible reaction network. 

Lemma 4.6. Any weakly reversible reaction network is recurrent. 

Proof A DRN models a weakly reversible reaction network if and only if V/' G [l;n],3m G [1; n] and 
TT : [1: m] ^ [1; n] such that Vk G [1; m],Ok = Oj + Vj + J^i^l V; and Oj = Oj + V, + V/. Therefore, 
e[l:n],Oj +Vj ^* Oj. □ 



12 



PER/TIM phosphorylations: 



PER/TIM degradations: 



PER-TIM complex formation: 
PER-TIM transport: 
PER-TIM degradation: 
PER/TIM transcription: 

PER/TIM production: 

PER/TIM mRNA degradation: 



PER_prot_u ^ PER_prot_p ^ PER_prot_p_p 
TIM_prot_u ^ TIM_prot_p ^ TIM_prot_p_p 
PER_prot_u TIM_prot_u -> 
PER_prot_p TIM_prot_p -> 
PER_prot_p_p TIM_prot_p_p 
PER_prot_p_p + TIM_prot_p_p ^ PERTIM_cyt 
PERTIM_cyt ^ PERTIM_iiuc 
PERTIM_cyt PERTIM_nuc -> 
PERTIM_nuc PERTIM_iiuc + PER_mRNA 
PERTIM_nuc PERTIM_iiuc + TIM_mRNA 
PER_mRNA -> PER_mRNA + PER_prot_u 
TIM_mRNA -> TIM_mRNA + TIM_prot_u 
PER mRNA -> TIM mRNA 



Figure 4: Reaction network of the PER/TIM circadian oscillations ([Leloup and Goldbeten . 119991) 



Example. The sufficient condition for recurrence depicted in Lemma \4~4\ is verified by example (a) of Fig. QJ 
Indeed, — >* (6, 6) — >* (applying 3Vi then 2V3 from results in (6, 6), then applying 6V2 results in 0). 
Hence, example (a) is recurrent (but not irreducible), whereas example (b) is irreducible (and recurrent). 

5 Biological Examples 

This section applies the results of this paper to show that a model of Circadian clock is LCN irreducible, 
and a generic model of phosphorylation chain is LCN recurrent. 



5.1 Circadian clock 



We study here a model of PER and TIM circadia n oscill ations from 



from the BioModels database ( Le Novere et a I 



Leloup and Goldbeterl (|l999r) . extracted 



20061 ). This model involves 10 species and 26 reactions 



(including 6 reversible). The list of reactions is given in Fig.E] 

One can check that the necessary and sufficient conditions for LCN irreducibility of Theorem 13.41 are 
verified by this DRN. Hence, there exists a threshold on the population of species such that there exists a 
succession of reactions connecting any pair of states above this threshold. 

Because no reaction has an origin being 0, the DRN is not self-starting, hence not fully irreducible; and 
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because of the presence of degradation reaction, the DRN is not fully recurrent (for instance, is reachable 
from the state where all species are except PER_mRNA being 1, but the converse is false). 



5.2 Phosphorylation chains 

We consider a generic model of chains of phosphorylation, where an enzyme E can progressively phos- 
phorylate a protein up to a cert ain level k. In concurrence, a kinase F can progressively de-phosphorylate 



this protein ([Anqeli et al 



20071) . 



So + E ^ SoE ^ Si + E ^ SiE S2 + E ^ > Sk + E 

So + F ^ SiF U Si + F ^ S2F ^ S2 + F i ±^ Sk + F 

Because of mass conservation properties (notably J2m=o being constant), such a DRN is not irredu- 
cible - in particular, spanjj^jjV 7^ M'^. 

Assuming LCN, one can notice that the irreversible reactions such as SmE — >■ Sm+i + E can be undone 
using the chain of reaction Sm+i + F — > Sm+iF — > Sm + /" followed by Sm + E — >■ SmE. The undo of 
Sm + F -tr- SmF irreversible reactions is achieved similarly. This shows that the DRN is LCN recurrent as 
G spanjj^jjV. In addition, we remark that it is actually sufficient that all the species are present with at 
least one copy in order to undo any irreversible reaction of this network (i.e.. Mo can be the vector having 
all its components being 1). 

Removing the LCN hypothesis, and in particular considering that F is absent (0 copy), it becomes 
impossible to revert the reaction SqE — )• Si + E. Hence, the DRN is not fully recurrent. 

LCN irreducibility depends both on stoichiometry properties (as highlighted by the two examples in 
Fig. [T|) and on the dimension of the lattice generated by V: if the free Z-module generated by V has a 
lower dimension than V, the DRN is not LCN irreducible. This typically occurs in the presence of mass 
conservation properties, as highlighted by the example on phosphorylation chains. 

In addition, as stated in Lemma [431 we recall that any weakly reversible reaction networks is recurrent, 
as the necessarily verify G span^ V. 



6 Discussion 

Relationships between DRNs and stochastic models dynamics Markov chains are a widely used mod- 
elling framework for analysing dynamics of biochemical reaction networks. Typically, the discrete states of 
such Markov chains represent the population of each biochemical species, and the transitions follow the 
drift vectors of reactions, when applicable (population of species greater than the reaction origin). Then, 
Markov chains associate either probabilities (DTMCs) or continuous rates (CTMCs) to transitions following 
biochemical laws, for instance. 
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n that sense, a DRN can be considered as the underlyi ng discrete dynamics of any Markov chain 



modelling the same set of reactions (jFages and Soliman 



20081 ). If we assume that the probabilities or rates 



associated to reactions are never null, we obtain the following correspondence between DRNs and Markov 
chains dynamical properties: 

• DRN is irreducible if and only if the associated Markov chain is irreducible. 

• DRN is recurrent if and only if all states in the associated Markov chain are recurrent. 

In the case where probability or rates may become null, DRN irreducibility (resp. recurrence) is still a 
necessary condition for Markov chain irreducibility (resp. recurrence). 

We note that a DRN which is not recurrent implies that there exists some irreversible steps. Such a 
reversib le property allovys, for instance, an efficient characterization of the stationary distribution in Markov 



chains (Anderson et al 



2010 ) 



Relationships between DRNs and continuous models dynamics Continuous models of reaction net- 
works, such as ODE equations, typically evolve in the continuous space of concentrations of species and 
assume that species are present in large copy numbers. In that way, we may want to relate dynamical 
properties of such continuous models of reaction networks to LCN properties of DRNs. 

In particular, one can remark that if a DRN is not LCN recurrent, i.e. ^ spanjj^gl^, there exists 
a hyperplane in M'' such that all reaction vectors point in the same side of this hyperplane, and at least 
one reaction vector points strictly inside this half-space. This implies that no oscillation is possible in the 
continuous dynamics: a non-zero drift is always pushing the system in a constant direction. 



Future work One possible future direction following the presented results is the derivation of necessa 



ry 



20121 ) 



or sufficient conditions for a discrete definition of persistence in continuous models (jCraciun et al. 
Persistence is the capability for a system to recover a strictly positive population for all species whenever 
one the species approaches zero. 

One suggested discrete version of this dynamical property is given in Def. l6.1l We remark that recurrence 
is a particular case of persistence (Remark[3). 

Definition 6.1 (Persistence). DRN iV,0) is persistent if and only ifMx e Z^o,Vx' G Z^p s.t. 3k e 
[1; d].xl = 0, X ^* x' ^ 3x" e Z^q.x' x" . 

Remark 3. Recurrence =^ Persistence. 

More generally, the study of Discrete Reaction Networks allows to efficiently prove the absence of certain 
dynamical properties in a wide-range of concrete models as they are independent of kinetic parameters. 



15 



Acknowledgements 

The work of GC was supported by NIH grant R01GM086881. 

References 

Anderson, D., Craciun, G., and Kurtz, T. (2010). Product-form stationary distributions for deficiency zero 
chemical reaction networks. Bulletin of Mathematical Biology, 72:1947-1970. 

Angeli, D., Leenheer, P. D., and Sontag, E. D. (2007). A petri net approach to the study of persistence in 
chemical reaction networks. Mathematical Biosciences, 210(2) :598 - 618. 

Cohen, H. (1993). A course in computational algebraic number theory. Springer-Verlag. 

Craciun, G., Nazarov, F., and Pantea, C. (2012). Persistence and permanence of mass-action and power-law 
dynamical systems. SIAM Journal on Applied Mathematics, to appear. 

Craciun, G., Tang, Y., and Feinberg, M. (2006). Understanding bistability in complex enzyme-driven reaction 
networks. Proceedings of the National Academy of Sciences, 103(23):8697-8702. 

Pages, F. and Soliman, S. (2008). Abstract interpretation and types for systems biology. Theoretical 
Computer Science, 403(1):52 - 70. 

Feinberg, M. (1979). Lectures on chemical reaction networks. Notes of lectures given 
at the Mathematics Research Center of the University of Wisconsin available online at 
http : //www . chbmeng. ohio- state . edu/~f einberg/LecturesOnReactionNetworks/ 

Johnston, M., Siegel, D., and Szederkenyi, G. (2012). A linear programming approach to weak reversibility 
and linear conjugacy of chemical reaction networks. Journal of Mathematical Chemistry, 50:274-288. 

Le Novere, N., Bornstein, B., Broicher, A., Courtot, M., Donizelli, M., Dharuri, H., Li, L., Sauro, H., 
Schilstra, M., Shapiro, B., Snoep, J. L., and Hucka, M. (2006). BioModels Database: a free, centralized 
database of curated, published, quantitative kinetic models of biochemical and cellular systems. Nucleic 
Acids Research, 34(Database issue):D689-D691. 

Leioup and Goldbeter (1999). Chaos and birhythmicity in a model for circadian oscillations of the PER and 
TIM proteins in drosophila. J Theor Biol, 198(3):445-459. 

Wilkinson, D. J. (2006). Stochastic Modelling for Systems Biology. Chapman and Hall/CRC. 



16 



